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1.   Introduction 

In  an  earlier  paper,  a  theory  of  consistency  in  ambiguous 
labelings  of  objects  has  been  developed  .  This  theory  allows  the 
relaxation  labeling  algorithm  to  be  interpreted  as  a  method  for  finding 
consistent  labelings  and  allows  specific  applications  to  be  tailored  in 
accordance  with  intended  design  goals.  We  begin  by  discussing  the 
general  class  of  problems  to  which  this  theory  is  applicable.  We  then 
outline  the  theory  of  consistency  and  the  principal  results  implied  by 
the  relaxation  labeling  algorithm  in  conjunction  with  this  theory. 
Finally,  we  discuss  a  design  methodology  for  implementing  applications. 


2.  Labeling  Problems 

The  discrete  labeling  problem  occurs  when  each  of  a  finite  number 
of  objects  are  to  be  assigned  a  label  chosen  from  a  finite  label  set. 
Let  aj,a2,...,a^  denote  the  n  distinct  objects,  and  {Xj,...,X^}  the  set 
of  possible  labels.  An  unambiguous  labeling  is  then  an  assignment 
mapping  objects  to  labels.  For  example,  if  object  a.  is  labeled  by 
Xj,  ,  then  the  integer  map  i  •*    l^   can  be  used  to  define  the  labeling. 

In  practical  systems,  measurements  are  made  to  describe  object  a^, 
and  a  most  probable  label  is  assigned  independent  of  the  labels 
assigned  to  neighboring  objects.  However,  these  decisions  may  be  in 
error  because  of  the  myopia  of  a  purely  local  viewpoint.  Further, 
since  the  decision  as  to  which  label  to  assign  to  a  particular  object 
is  fraught  with  uncertainty,  information  is  discarded  when  we  eliminate 
possible  but  improbable  labels  in  favor  of  a  single  label  at  each 
object. 
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Consequently,  it  is  useful  to  extend  the  notion  of  labelings  to 
weighted  labeling  assignments.  In  this  model,  a  nonnegative  weight 
pASi)  is  assigned  for  each  label  in  the  label  set,  at  every  object. 
The  weight  p.(Jl)  denotes  the  confidence  level  that  object  a^  should  be 
labeled  by  label  X.  .   These  weightrj  at';  normalized  by  the  condition 


x=i 


The  assignment  p^il)  =  1  signifies  that  object  a^  is  unambiguously 
labeled  by  label  X,  ,  (see  [2]),  (The  distribution  of  values 
(Pj^(l),...  ,p^(ra))  at  object  i  makes  the  weights  look  very  much  like 
probabilities,  but  this  viewpoint  is  unhelpful). 

By  concatenating  assignment  weights,  we  can  form  an  assignment 
vector  p  =  (pp...,Pj^),  p^  =  (p^(l),  p^(2),.  . .  ,p^(m)).  (Due  to  the 
normalization  condition,  there  can  be  only  one  component  with  a  value 
one  at  each  object).  We  call  the  space  of  all  possible  assignment 
vectors  p  the  assignment  space  IK.  The  set  of  unambiguous  labelings 
can  be  viewed  as  a  subset  IK*  IK,  and  is  described  by  labelings  in 
which  all  assignment  components  p^(2.)  are  either  0  or  1.  It  is  not  hard 
to  show  that  IK  is  the  convex  hull  of  IK*  . 
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3.   Support  Functions 

To  apply  the  relaxation  labeling  method  we  must  be  given  a  set  of 
objects  and  a  label  set,  and  also  support  functions  Sj^(Ji;p),  which  are 
functions  of  the  labeling  assignment  p.  A  separate  support  function  is 
given  for  each  label  at  each  object.-  Whereas  p^il)  denotes  the  current 
confidence  level  that  object  a^  is  label  Xj^ ,  s^(£;p)  denotes  the 
support  which  the  current  mix  of  assignments  of  labels  to  objects  in 
the  vicinity  of  object  a.  lends  to  the  proposition  that  object  a^  is 
label  A,.  If  the  assignment  p  gives  high  confidence  levels  to  labels 
which  are  compatible  with  label  number  I  at  object  number  i,  then 
s.(£;p)  will  be  large  and  positive."  If  the  local  assignment  of  labels 
near  object  a.  leads  to  labels  incompatible  with  X^^  at  a^,  then  S£(i;p) 
will  be  negative. 

In  nearly  all  applications  to  date,  the  support  functions  have 
been  linear  functions  of  the  labeling  assignment  p.  Thus  there  exist 
constants  t.-(Z  ,1  ' )   for  every  pair  of  object  labels  so  that 

n   m 
s.a;p)  =1       I        r.  .  a,i')vAl')   . 
j=l  ^'=1 

In  this  model,  r.  •(£.,£')  represents  the  degree  of  compatibility  between 
the  decision  to  label  a^  by  Xg_  given  that  label  \^'  has  been  assigned 
to  a..  This  compatibility  coefficient  can  be  either  positive  or 
negative,  depending  on  whether  label  Xn'  at  a^  lends  positive  or 
negative  support  to  label  X.    at  a^  . 

It  is  of  course  essential  to  know  where  the  support  functions  come 
from.  In  first  stating  the  theory,  it  is  enough  to  suppose  that  the 
s.(Jl,p)'s   are  "God-given."  However,  the  principal  task  confronting  the 
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designer  of  a  relaxation  labeling  application  is   the  definition  of 
formilae  for  computing  the  support  functions.   In  Section  7,  we  show 
how  the  distinction  between  consistent  and  inconsistant   labelings   can 
be  used  to  constrain  the  choice  of  support  functions. 

4.  Consistency 

A  consistent  assignment  of  la'ccls  to  objects  has  historically  been 

defined  to  mean  an  assignment  vhich  satisfies  a  system  of   logical 

constraints   [3,4].   Use  of   support   functions   allows  us  to  define 

consistency  relative  to  a  quantitati/e   system  of   preferences,   i.e. 

numerical  weighted  constraints.   This   extension  applies  to  weighted 

labeling  assignments  as  well  as  unambiguous   labelings.    In  reviewing 

these  notions,   it   is  convenient  to  begin  by  discussing  the  situation 

for  unambiguous  assignments.   Consistency  is  defined  relative   to   the 

set   of   support   functions.   Suppose  p  e  IK*  represents  an  unambiguous 

label  assignment  which  labels  objects   a.   ,   i   =   l,...,n  to   labels 

X.  ,...,  Xg        respectively.   We  will  say  that   the   labeling  p  is 
*  1        ^ra 

consistent  if 

S£()l^;p)  >    s^()l;p)   for  all  I,      for  i  =  l,...,n  . 

That  is,  the  unambiguous  labeling  is  consistent  if  at  each  object  the 
maximum  support  value  is  attained  for  the  label  actually  assigned  to 
that  object.  In  other  words,  the  distribution  of  support  values  is  in 
agreement  with  the  label  assigned  to  every  object.  Note  that  support 
values  are  defined  for  every  label  at  any  given  object,  including  those 
labels  which  are  not  assigned  (have  zero  assignment  weights),  and  that 
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the  calculation  of  the  support  values  depends  upon  the  assignment   of 
weights  at  neighboring  objects. 

At  first  glance,  it  may  seem  trivial  to  find  a  consistent 
labeling.  Many  people  suggest  that  assignments  be  changed  so  that  the 
label  with  maximum  support  becomes  the  assigned  label  at  each  object. 
However,  such  a  procedure  fails  because  the  support  values  will  change 
when  labeling  assignments  are  -changed.  Instead,  the  consistency 
condition  should  be  viewed  ^s  a  i coupled  system  of  inequalities, 
expressing  a  "locking-in"  property  between  the  support  values  and  the 
assignment  weights.  -v 

Of  course,  many  of  the  m"  possible  unambiguous  labelings  will  not 
be  consistent.  We  cannot  even  guarantee,  a  priori,  the  existence  of  a 
consistent  unambiguous  labeling. 

For  weighted  labeling  assignments,  we  will  say  that  p  e  IK  is 
consistent  if 

ra  m 

I    p^a)s.a;p)  >  I   v.a)Si(Ji;p) 

Z=l  Z=l 

for  all   V  e  IK  , 

for  i  =  1,. .. ,n  . 

This  definition  is  equivalent  to  the  previous  definition  if  p  happens 
to  be  unambiguous.  Simply  stated,  consistency  occurs  when  the  set  of 
convex  combinations  of  support  values  at  a  given  object  is  maximized  by 
the  combination  which  chooses  as  its  weights  the  assignment  values,  if 
this  property  holds  true  simultaneously  at  all  objects. 
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5.  The  Relaxation  Labeling  Algorithm 

A  relaxation  labeling  process   for  problems   formulated  on  the 
assignment  space  IK  can  use  the  following  algorithm. 

Step  1:  Examine  each  object  a.,  i  =   l,.,.,n,   and  using  measurements 
about  each  object,  obtain  initial  weighted  assignments  p. (I), 
Z      =      1 , . . . ,m  signifying  the   confidence  level  for  labeling  a.  by  Xn. 


Step  2:  LOOP  until  convergence: 

i.  Compute  q^  ,  where  q\(l)   =   s.(A;p^) 
ii.   Find  the  projection  of  q^  : 

u^  :=  Projection-Operator  (q^  ,  p^)  o 
iii.   If  u'^  =  0,  then  QUIT  the  loop. 


P*"  +  a^u^ 


where  a.  is  chosen  smaller  than  some  predetermined  step  size 
(which  may  decrease  as  k  increases)  and  so  that  p    e  IK. 
Increment  k,  k  :=  k+1 ,  and  repeat  loop. 


Step  3:  (Output  of  results)  Assign  label  at  each  object  by   selecting 
the  label  with  maximum  current  assignment  weight.   Output  these  labels. 
The  projection  operator  used  in  Step   2ii   is   defined  by  the 
following  algorithm  [5]: 

1.  Accept  q  =  (qj,...,q^)  e  (IR"")"  and 
p  =  (p]^ , . . .  ,Pj^)  e  IK  as  input. 

2.  For  i  =  l,...,n  do: 

a.   Set  D  :=  {k|p^(k)  =  0},  S  :=  0 


b.   LOOP  until  a  quit  is  executed 
i.   Set  ns  :=  //S 
ii.   Set  t    :=    (   I      q.(k))/(m-ns) 

Ws 


lii.   S  :=  (k  E  D|q^(k)  <  t} 


iv.   If  //S  =  ns,  then  Quit,  otherwise  repeat  loop, 
c.   Set  u^(k)  =  qj(k)  -  t   for  k  §f  S, 
u^(k)  =0  for  k  e  S  . 

3.  Normalize  u  by  ••■■.^■^^'■ 

u  :=  u/ll  ull    if  u  ^  0  , 
u  :=  0       otherwise  . 

4.  Return  the  vector  u  . 

The  third  step  may  be  expensive.  In  many  applications,  the 
individual  subvectors  u^  are  normalized  independently,  which  is 
computationally  much  easier,  and  probably  does  not  change  the 
qualitative  behavior  of  the  relaxation  labeling  algorithm  by  much. 
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6.   Theorems 

The  following  results  relate  the  notion  of  consistency  and  the 
relaxation  labeling  algorithm  formulated  above.  Proofs  are  given  in 
[1]. 

Result  Ij  If  the  relaxation  labeling  algorithm  stops  at  p,  then  p  is  a 
consistent  labeling. 

Result  2;  If  the  support  functions  s.(£,p)  are  continuous  in  p,  then 
there  always  exists  at  least  one  consisuent  labeling. 

Result  _3:  Suppose  p  e  IK*  is  an  unambiguous  consistent  labeling. 
Suppose  further  that  p  is   strictly  consistent,   in  the   sense   that 

Sj^(Jlj^,p)   >  s.(£,p)   for  i     t      Jl^,  i  =  1 n,  where  p  labels  object 

number  i  by  label  number  £..  Then  there  exists  a  neighborhood  of  p  in 
IK  such  that  if  the  iterates  of  the  relaxation  labeling  process  enter 
this  neighborhood, or  begin  in  it,  then  the  process  will  converge  to  p 
(by  a  path  of  finite  length)  . 

Result   4_:   Suppose  that  the  support  functions  are  linear  in  p,  and  the 
corresponding  coefficients  r.. (£,£')  are  symmetric;  i.e.,   r..(Jl,X.') 
r.Al',1).        Then  the  relaxation  labeling  process  is  equivalent  to  the 
method  of  steepest  ascent  for  maximizing 


I  ).  ).  ).    r^.a,£')p.a)p.a') 

i  j  i  £' 


on  IK  . 
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7.  Defining  Support  Functions 

The  preceding  sections  have  summarized  the  results  of  [1];  in  this 
section  we  present  ideas  not  included  in  that  paper.  These  relate  to 
the  fundamental  pragmatic  fact  that  the  principal  motivation  for 
developing  a  theory  of  consistency  in  conjunction  with  the  relaxation 
labeling  algorithm  is  to  be  able  to  design  support  functions  well 
adapted  to  particular  applicative^. 

Suppose  that  objects  and  l.g.he]f j,s,ets  have  been  identified,  and  that 
formulae  for  support  functions  are  required.  The  following  method  is 
suggested.  .  .  .-   ,  ,    •.  ; 

Certain  patterns  of  unambiguous  labelings  can  be  identified  as 
consistent  labelings.  Suppose,  for  example,  that  an  unambiguous 
labeling  i  -^  I  ^,  denoted  succinctly  by  2.  =  (i  ]^, . . .  ,1^) ,  is  to  be  viewed 
as  consistent.  Let  p  be  the  corresponding  unambiguous  assignment 
vector.  Then  we  want  the  inequalities  s.(£.,p)  >  s^(£;p),  to  be 
satisfied.  If  the  support  functions  are  to  be  designed  as  linear 
functions  of  p,  these  conditions  can  be  written  as 


I    r^.a^,ip  >   I    T^.a,l^),      all  I,    all  i 


which  are  all  deemed  to  be  consistent.   Then  we  want 


j  j 


to  be  satisfied  for  all  I,    all  i,  k  =  1 N  . 
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These  conditions  may  constitute  a  large  number  of  linear  inequalities 
in  the  set  of  variables  r..(i,i').  The  system  of  inequalities  may  have 
no  nontrivial  solution,  in  which  case  it  '  is  impossible  to  design 
linear  support  functions  with  Z  ,...,Z  as  consistent  labeling 
patterns.  However,  if  the  system  has  a  nonempty  solution  set,  then  any 
assignment  of  values  to  the  r..(i.i")'s  satisfying  the  inequalities  is 
called  a  feasible  solution.  In  this  case,  linear  programming  methods 
(such  as  the  simplex  method)  can  be  used  to  find  feasible  solutions. 

The  set  of  feasible  solutions  forms  a  cone.  That  is,  any  set  of 
values  for  the  r..(;i,£')'s  can  be  multiplied  by  a  uniform  positive 
scalar,  and  the  resulting  set  will  still  provide  a  feasible  solution. 
This  is  clear  from  the  form  of  the  inequalities.  Of  course,  such 
multiplication  will  not  affect  the  relaxation  labeling  algorithm. 

If  the  interior  of  the  set  of  feasible  solutions  is  nonempty,  then 
there  exist  strictly  feasible  solutions.  A  strictly  feasible  solution 
is  an  assignment  of  values  to  the  r .  .(Jl  ,£  ' ) 's  such  that  the  system  of 
inequalities  hold  strictly.   That  is. 


I    r^.al,   z])    >  I    r.jOl,JlH),  all  I   *   i\,    all  i,  k  =  1,...,N. 
J  J 


If  a  strictly  feasible  solution  is  chosen,   then  the  initially   given 
labeling  patterns  £  ,...,£   will   correspond   to  strictly  consistent 


The  trivial  solution  v^Al,i')      =  0  is  uninteresting  because   it 
classifies  all  labelings  as  consistent. 
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labeltngs.    According  to  Result  3,  these  unambiguous  labeling  patterns 
will  then  be  local  attractors  of  the  relaxation  labeling  process. 

It  may  well  happen  that  a  strictly  feasible  solution  will  yield 
other  consistent  unambiguous  labelings  not  represented  in  the  design 
pattern  set.  This  may  be  undesirable,  and  will  require  a  search  for  a 
feasible  solution  which  minimizes ^the  problem  of  spurious  consistent 
labelings.  An  example  in  the  ne^t  sqction  illustrates  a  method  for 
accomplishing  this  search.    j  hi>Bii   - " 

8.   Examples  ..y.-; 

It  is  instructive  to  consider  a  few  simple  examples. 

Suppose  that  the  graph  of  objects  is  given  by  a  hexagonal  grid,  so 

that  each  object  is   equidistant   from  six  neighbors.   Consider   the 

simplest   case  of   two   labels.   We  suppose  that  the  following  local 
patterns  are  consistent: 

11             2  2  12           2  1 

111           222  112          221 

II             2  2  11           2  2 

Further,  we  assume  that  the  relationship  of  consistency  is  "isotropic", 
that  is,  a  rotation  of  a  consistent  labeling  is  consistent. 

Note  that  labels  1  and  2  are  treated  symmetrically  in  this 
example,  so  in  searching  for  coefficients  r.  .  we  can  assume  that 
r^j(l,l)  =  r^j(2,2)  and  r^j(l,2)  =  r^j(2,l).  Further,  since  each 
neighbor  is  equidistant  and  direction  is  unimportant,  the  r. .'s  are 
independent  of  i  and  j  as  long  as  i  and  j  are  distinct  neighboring 
objects.   (We  assume  that  the  r^^(i  ,l')'s   are  zero.) 
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Thus  only  two  parameters  will  enter  into  the  coefficients  r.  .  that 
we  seek:  for  i  and  j  distinct  neighbors,  we  set  a  =  r.  .(1,1)  and  b  = 
r.  .(1,2).  Applying  the  conditions  for  strict  consistency  to  each  of 
the  patterns  listed  above  leads  to  the  single  condition  a  >  b. 

What  other  unambiguous  local  patterns  are  consistent  in  this 
scheme?  Let  n,  be  the  number  of  1-labels  among  the  six  neighbors  of  a 
central  object,  and  n2  be  the  number  of  2-labels.  Then  the  support  for 
label  1  is  s(l)  =  anj^  +  bn2  and  the  supporc  for  label  2  is  s(2)  =  an2  + 
bn,.  A  local  pattern  with  a  central  object  labeled  with  a  "1"  is 
strictly  consistent  if  s(l)  >  s(2)>  ieec,  n^^  >  .19.  (Note  that  a-b  > 
0).  Similarly,  "2"  is  consistent  for  the  central  object  of  a  local 
pattern  if  n2  >  ni. 

Remarkably,  the  same  set  of  patterns  are  consistent  whatever  the 
values  of  a  and  b,  as  long  as  a  >  b.  This  confirms  empirical  evidence 
of  the  robustness  of  simple  relaxation  labeling  applications  to 
modifications  of  the  compatibilities. 

A  global  unambiguous  labeling  will  be  strictly  consistent  in  this 
model  if  every  object  is  labeled  with  the  majority  label  as  voted  by 
the  six  neighbors.  Since  the  condition  holds  at  every  object,  it  is 
not  hard  to  see  that  strictly  consistent  labelings  consist  of  strips  of 
I's  and  2's  with  straight  parallel  interfaces  between  the  regions. 
These  straight  line  interfaces  must  occur  in  one  of  the  six  principal 
directions  of  the  hexagonal  grid. 

Clearly,  this  example  is  too  simple  to  be  of  assistance  in  any 
practical  application.  We  will  consider  a  slightly  more  complicated 
situation  to  illustrate  the  method.  However,  practical  situations  will 
generally  be  much  more  complex  than  either  of  our  examples. 
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As  in  the  previous  example,  consider  a  hexagonal  array  of  objects, 
this  time  with  three  labels.  The  labels  are  "1"  and  "2"  which  we  can 
regard  as  "region  types",  and  label  "3"  to  denote  "edge  between  1  and 
2's".  We  regard  a  local  pattern  of  either  constant  I's  or  constant  2's 
as  a  consistent  labeling: 

I  1       ,,;^.  _        2  2 

.  1  1  Ir  -,.   ,,^     2  2  2 
1  1.  .^  ,  .  ,,..,    2  2 

A  region  of  I's  separated  fjrom  2.'srby  a  line  of  3's  is  consistent: 
3  2 
1  3  2 

I  3 

For   the   same   reason 

13  2  3 

113  and  2    2   3 

II  2  2 

are  regarded  as  consistent.    As   before,   we   treat   labels   1   and  2 
symmetrically,  and  assume  isotropy. 
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Set 

a  =  r(l,l)  =  r(2,2) 
b  =  r(l,2)  =  r(2,l) 
c  =  r(3,3) 
d  =  r(1.3)  =  r(2,3) 
e  =  r(3,l)  =  r(3,2)  . 

Each  pattern  yields  two  inequalities  to  constrain  the  five  parameters. 
From  the  constant  patterns,  we  deduce 


a  >  b 
a  >  e 


From  the  pattern  with  two  I's  and   two   2's,   4e  +  2c  >  2a  +  2b  +  2d, 
i.e., 

2e+c>a+b+d, 

and  from  the  pattern  with  only  two  3's,  4a  +  2d  >  2c  +  4e  ,  i.e., 
2a  +  d  >  2e  +  c  . 

Combining,  we  have 

a  >  b,  a  >  e,  and 
(a-e)  +  (b-e)  <  c-d  <  2(a  -  e). 
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It  is  easy  to  see  that  feasible  solutions  of  these  equations  exist  and 
can  be  readily  constructed.  In  particular,  choose  any  positive  value 
for  a',  then  choose  b'  <  a',  and  e  arbitra-ry.  Set  a  =  a'+e,  b  =  b'+e, 
and  finally  choose  a  value  for  c-d  between  a'+  b'  and  2a'.  The  values 
for  c  and  d  can  be  selected  so  that  the  difference  is  the  specified 
value. 

The  designated  patterns,  and  all  their  rotations,  will  be  strictly 
consistent  under  the  compatibilities  of  any  feasible  solution.  We  will 
now  try  to  select  a  feasible  solution  which  gives  rise  to  as  few  other 
consistent  labeling  patterns  as  possible. 

Let  n^j  n2  and  ni  denote  the  number  of  neighbors  of  a  central 
object  of  a  local  hexagonal  cell  having  labels  1,  2,  and  3 
respectively.  The  label  "1"  at  the  central  object  is  part  of  a 
consistent  pattern  if 

anj^  +  bn2  +  dn3  >  dn^  +  an2  +  dn3 
and  anj^  +  bn2  +  dn3  >  enj^  +  en2  +  cn3  . 

From  the  first  inequality,  and  the  fact  that  a  >  b,  we  obtain 
n^  >  n2  . 

Using  the  fact  that  nj^  +  02  +  n3  =  6,  the  second  inequality  becomes 
[(c-d)  +  (b-e)]n3  <  (a-b)ni  +  6(b-e)  . 
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In  a  similar  way,  it  can  be  shown  that  "3"  is  a  consistent   label 
for  the  central  object  of  a  local  pattern  if 

[(c-d)  +  (b-e)]n3  >  (a-b)«  inax(ni  ,n2)  +  6(b-e)  . 

Let  us  arbitrarily  choose  a  =  1,  and  b  =  -1.   Then  e  =  r(3,l)  =  0 

makes  sense  since  "3"  and  "1"  can  co-occur.   Having  chosen  a,b,  and  e, 

then  0  <  c-d   <  2.   Suppose  we   choose   c-d  =  1.  Then  applying  the 
conditions  above,  a  central  "1"  is  consistent  if 

nj  >  02  and  nj^  >  3  . 

For  a  "3"  to  be  consistent,  it  suffices  to  have 

max(nj^,n2)  <  3  . 

Thus  a  pattern  with  a  "1"  or  "2"  label  in  the  center  is  consistent 
if  there  are  four  or  more  of  the  same  label  type  in  the  neighborhood. 
A  central  "3"  is  consistent  as  long  as  there  are  two  or  fewer  "r"s  and 
two  or  fewer  "2"'s  in  the  neighborhood. 

This  seems  to  be  reasonable  behavior.   But  note  that  the  pattern 
I  2 
1  X  2 
1  1 

is   consistent  with  x  =  1  under  the  above  choice  of  values.   We  would 
prefer  the  support  for  x  =  3  to  be  higher  than  the  support  for  x  =  1  to 
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justlfy  the  interpretation  of  label  "3"  as  "edge."  Thus  we   would   like 
6e  >  4a  +  2b. 

Having  chosen  a  =  I ,  b  =  -1 ,  we  now  see  that  e  >  1/3  is  desirable. 
Let  e  =  2/3,  whence  -2/3  <  c-d  <  4/3.  By  varying  the  value  of  one 
parameter  c-d,  different  behavior  of  the  patterns  of  consistency  can  be 
selected.  For  example,  suppose  we  choose  c-d  to  be  1/2.  Then  by 
applying  the  previous  inequalities  and  a  simple  case  analysis,  the 
following  statements  can  be  made  for  this  assignment  of  weights: 

A  "1"  label  is  consistent  only  if  there  are  four  or  more  "1"  labels 
among  the  six  neighbors,  and  no  "2"  labels. 

A  "3"  label  is  consistent  if  there  are  three  or  more  "3"  labels  among 
the  neighbors,  or  if  there  are  four  of  label  type  "1"  or  "2",  and  at 
least  one  of  the  other  type. 

This  example  illustrates  how  an  initial  assignment  of  values  to  the 
r..(l  ,1  '  )'s  obtained  as  a  feasible  solution  can  be  refined  to  give  more 
desirable  behavior  by  the  addition  of  a  constraint.  In  this  case,  the 
additional  inequality  arises  when  we  decide  to  reject  a  spurious 
consistent  pattern,  and  the  statement  that  a  particular  label  should 
have  greater  support  than  the  otherwise  consistent  label. 
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